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. ^ ATTORNEY DOCKET NO. ; CISOO-2413 

IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Applicants: Lewis D. Dodrill, Ryan A. Danner, and Steven J. Martin 

Serial No.: 09/679,109 

For: APPARATUS AND METHODS FOR CONVERTING TEXTUAL 

INFORMATION TO AUDIO-BASED OUTPUT 

Filing Date: October 4, 2000 

Examiner: Han, Ql 

Art Unit: 2654 

Conf. No.: 1822 




Certificate of Mailing Under 37 C.F.R. S1.8 

I hereby certify that this correspondence is being deposited with the United States Postal Service vith 
sufficient postage as first class mail in an envelope addressed to: MAIL STOP AMENDMENT 
Commissioner fcr Patents. PO Box 1450, Alexandria, Virginia 22313-1450 on: 



Date: 



By: ^ . 

(Typed or printed name of person mailing 
Document, whose signature appears below) 



Signature; 



MAIL STOP AMENDMENT 
Commissioner for Patents 
PO Box 1450 

Alexandria, Virginia 22313-1450 



Best Available Copy 



AFFADAVIT UNDER 37 CFR 1.131 



1 . 1, Lewis D. Dodrill, am a co-inventor of "Apparatus and Method for Convertii ig 
Tefxtua] Information to Audio-based Outpuf now before the U. S. Patent Office as 
Application Nximber 09/679,109. 



11/12/2004 16:47 FAX 202 331 79t,_ THE JEFFERSON HOTEL 

Nov la 2004 12:OG CHRPIN & HUflMG,L.L.C. 150861S9805 



@003/005 
p . 3 



2. It is my belief that inventorship in the above-identified patent application is 
correct 

3 . Prior to March 24, 2000, 1 conceived of the invention of "Apparatui; and Method 
for Converting Textual Information to Audio-based Output" now before the; U. S. Patent 
Office as AppBcation Number 09/679.109 jointly with the co-inventore najned in th<! 

. above-identified patent application. 

4. Prior to March 24, 2000, 1 jointly, with the eo-inventors named in ths above- 
identified patent application, reduced to practice the invention described and claimed in 
Application Number 09/679.1 09, now pending in the U.S. Patent OfTioe, as evidence.1 by 
the attached invention disclosure. 

5. All of the statements made herein are of my own knowledge md are true, thes? 
statements were made with the knowledge that wiUftil false statements and ihe like sc- 
made are punishable by fine or imprisonment or both, under § 1001 of Title 18 of the 
United States Code and that such willful false statements may jeopardize tht; validity of 
the application and any patent issuing thereon, or any patent to which this verified 
statement is applied. 

Ddte of Signature Lewis D . Dodrill 
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Certificate of Mailing Under 37 C.F.R. §1.8 

I hereby certify that this correspondence is being deposited with the United States Postal Service with 
sufficient postage as first class mail id an envelope addressed to: MAIL STOP AMENDMENT 
Commissioner for Patents. PO Box 1450, Ale?;andria, Virginia 22313-1450 on: 



Date: i^/ V ^^^H By 



(Typed or printed name of person mailing 
Document, whose signature appears below) 



Signature: 



MAIL STOP AMENDMENT 
Commissioner for Patents 
PO Box 1450 

Alexandria, Virginia 22313-1450 



AFFADAVIT UNDER 37 CFR 1.131 



1. I, Ryan A.^gs^r'am a co-inventor of "Apparatus and Method for Converting 
Textual Informatiot) to Audio-based Output" now before the U. S. Patent Office as 
Application Number 09/679,109. 



It is my belief that inventorship in the above-identified patent application is 



3. Prior to March 24, 2000. 1 conceived of the invention of "Apparatus and Method 
for Converting Textual Information to Audio-based Output" now before the U. S. Patent 
Office as Application Number 09/679.109 jointly with the co-inventors named in the 
above-identified patent application. 

4. Prior to March 24, 2000, 1 jointly, with the co-inventors named in the above- 
identified patent application, reduced to practice the invention described and claimed in 
Application Number 09/679.109, now pending in the U.S. Patent Office, as evidenced by 
the attached invention disclosure. 

5. All of the statements made herein are of my own knowledge and are true, these 
statements were made with the knowledge that willful false statements and the like so 
made are punishable by fine or imprisonment or both, under § 1001 of Title 18 of the 
United States Code and that such willful false statements may jeopardize the validity of 
the application and any patent issuing thereon, or any patent to which this verified 
statement is applied. 



correct. 
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Certificate of Mailing Under 37 C.F.R. §1.8 

I hereby certify that this correspondence is being deposited with the United States Postal 
Service with sufficient postage as first class mail in an envelope addressed to: MAIL 
STOP AF, Commissioner for Patents, PO Box 1450, Alexandria, Virginia 22313-1450 
on: 



Date: July 14. 2005 By: Marv A. Maietta 

(Typed or printed name of person mailing 
Document, whose signature appears below) 

Signature: 



MAIL STOP AF 

Commissioner for Patents 
PO Box 1450 

Alexandria, Virginia 22313-1450 

AFFADAVIT UNDER 37 CFR 1.131 



1 . Steven J. Martin is a co-inventor of "Apparatus and Method for Converting 
Textual Information to Audio-based Output" now before the U. S. Patent Office as 
Application Number 09/679,109. This is evidenced by his name being listed as an 
inventor on the invention disclosure (copy attached) and firom his being included as an 
inventor on the patent application as filed. 



2. It is my belief that, based on the above, inventorship in the above-identified patent 
application is correct. 

3. Prior to March 24, 2000, Steven J. Martin conceived of the invention of 
"Apparatus and Method for Converting Textual Information to Audio-based Output" now 
before the U. S. Patent Office as Application Number 09/679,109 jointly with the co- 
inventors named in the above-identified patent application. This is evidenced by the 
invention disclosure (enclosed herewith) having a date which precedes March 24, 2000. 

4. Prior to March 24, 2000, Steven J. Martin jointly, with the co-inventors named in 
the above-identified patent application, reduced to practice the invention described and 
claimed in Apphcation Number 09/679,109, now pending in the U.S. Patent Office. This 
is shown by the patent application being filed on October 4, 2000. 

5. Steven J. Martin refuses to sign an affidavit attesting to the above stated facts as 
related to me by the attorney (David W. Rouille) prosecuting the present application and 
as stated in the Declaration of David W. Rouille, a copy of which is enclosed herewith. 
Therefore I, Robert Barr, Esq., Vice-President Intellectual Property at Cisco Systems, Inc. 
am signing on behalf of the Assignee Cisco Systems, Inc. 

6. All of the statements made herein attributed to me are of my own knowledge and 
are believed to be true, these statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or imprisonment or both, under § 
1001 of Title 18 of the United States Code and that such willful false statements may 
jeopardize the validity of the application and any patent issuing thereon, or any patent to 
which this verified statement is applied. 




Vice President Intellectual Property 




ATTORNEY DOCKET NO. CISOO-2413 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Applicants: Lewis D. Dodrill, Ryan A. Banner, and Steven J. Martin 

Serial No.: 09/679,109 

For: APPARATUS AND METHODS FOR CONVERTING TEXTUAL 

INFORMATION TO AUDIO-BASED OUTPUT 

Filing Date: October 4, 2000 

Examiner: Han, Ql 
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Certificate of Mailing Under 37 C.F.R. SI. 8 

I hereby certify that this correspondence is being deposited with the United 
States Postal Service with sufficient postage as first class mail in an envelope 
addressed to: MAIL STOP AMENDMENT, Commissioner for Patents, PO Box 1450, 
Alexandria, Virginia 22313-1450 on: 



Date: December 14. 2004 



Mary A. Maietta 



By: 

(Typed or printed name of person mailing 
Document, whose signature appears below) 

Signature: 



MAIL STOP AMENDMENT 

Commissioner for Patents 
PO Box 1450 

Alexandria, Virginia 22313-1450 



Declaration Of David W. Rouille 



Dear Sir: 



My name is David W. Rouille and I am an attorney registered to practice 
before the United States Patent and Trademark Office, Registration 
No. 40, 150. 



U.S Application No.: 09/bo9.716 



Attorney uocket No.: CISOO-2413 



2. On or about November 4, 2004 I contacted Steven J. Martin via email at 
email address sim(a)cmguc.com regarding my plan to swear behind the 
references cited by the Examiner. A copy of the email is attached hereto. 

3. On or about November 12, 2004 I telephoned Steven J. Martin at (804) 762- 
5601. I discussed the office action with Mr. Martin and explained the affidavit 
(included with the email of November 4, 2004). Mr. Martin agreed to sign the 
affidavit and fax it back to me. Mr. Martin also explained to me how I may be 
able to get in touch with Mr Dodrill. 

4. On or about November 15, J sent a reminder email to Mr. Martin regarding the 
affidavit and that I had received signed affidavits from the othe rinvetors. A 
copy of this email is attached hereto. 

5. Between November 18, 2004 and December 7, 2004 I telephoned Mr. Martin 
several times. In each instance I left a voice mail message for Mr. Martin 
inquiring about the affidavit. 

6. On December 7, 2004 1 sent Mr. Martin another email regarding the affidavit. 
I received no answer from Mr.Martin regarding the email or phone 
messages. From this I assume that Mr. Martin is either unavailable or 
refuses to sign the affidavit 



U.S Application No.: 09/bu9.716 



Attorney uocket No.: CISOO-2413 



I hereby declare that all statements made herein of my own knowledge are true 
and that all statements made on information and belief are believed to be true; and 
further that these statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or imprisonment or both under 
Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued thereon. 



Respectfully submitted, 



Attorney Docket No.: CISOO-2413 



David W. Rouille, Esq. 
Attorney for Applicant(s) 
Registration No.: 40,150 
CHAPIN & HUANG, LLC. 
Westborough Office Park 
1700 West Park Drive 
Westborough, Massachusetts 01581 
Telephone: (508) 366-9600 
Facsimile; (508)616-9805 



Date: December 14. 2004 



David Rouille 



( 



From: David Rouille 

Sent: Thursday, November 04, 2004 2:52 PM 

To: 'sjm@cmguc.com' 

Subject: affidavit regarding patent application titled "Apparatus and Methods for Converting Textual 

Information to Audio-based Output" 



Steven, 

I am the patent attorney prosecuting this application through the Patent Office for Cisco. 
We received a rejection, citing three patents. Instead of arguing around the patents we 
can do something called "swearing behind" these patents. In this case, the date of 
invention precedes the priority date of the three patents cited against your application. 
I have prepared an affidavit {for each inventor) which basically states that you conceived 
of this prior to the date of the other patents. I will submit the CPOL record (with dates 
and product names redacted) as proof. Please review the attached affidavit and, if 
correct, sign and date. You can fax the signed affidavit back to me. Please feel free to 
contact me directly if you have any questions. Once I receive signed affidavits from all 
the inventors, I will file the responrse. 

Regards, 
Dave 




CISOO-2413 1.131 
Affidavit - M... 



David W. Rouille 
Chapin & Huang, LLC 
Westborough Office Park 
1700 West Park Drive 
Westborough, MA 01581 
(508)366-9600 (phone) 
(508)616-9805 (fax) 

This message is intended only for the designated recipient (s ) . It may 
contain confidential or proprietary information and may be subject to the 
attorney-client privilege or other confidentiality protections. If you are 
not a designated recipient, you may not review, copy or distribute 
this message. If you receive this in error, please notify the sender by 
reply e-mail and delete this message. Thank you. 



1 
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Certificate of Mailing Under 37 C.F.R. SI .8 

I hereby certify that this correspondence is being deposited with the United States Postal Service with 
sufficient postage as first class mail in an envelope addressed to: MAIL STOP AMENDMENT 
Commissioner for Patents, PO Box 1450, Alexandria, Virginia 22313-1450 on: 



Date: By: 

(Typed or printed name of person nnalling 
Document, whose signature appears below) 



Signature: 



MAIL STOP AMENDMENT 
Commissioner for Patents 
PO Box 1450 

Alexandria, Virginia 22313-1450 

AFFADAVIT UNDER 37 CFR 1.131 



1 . I, Steven J. Martin am a co-inventor of "Apparatus and Method for Converting 
Textual Information to Audio-based Output" now before the U. S. Patent Office as 
Application Number 09/679, 1 09. 



2. It is my belief that inventorship in the above-identified patent application is 
correct. 

3. Prior to March 24, 2000, 1 conceived of the invention of "Apparatus and Method 
for Converting Textual Irrformaticn to Audio-based Output" now before the U. S. Patent 
Office as Application Number 09/679,109 jointly with the co-inventors named in the 
above-identified patent application. 

4. Prior to March 24, 2000, 1 jointly, with the co-inventors named in the above- 
identified patent application, reduced to practice the invention described and claimed in 
Application Number 09/679,109, now pending in the U.S. Patent Office, as evidenced by 
the attached invention disclosure, 

5. All of the statements made herein are of my own knowledge and are true, these 
statements were made with the knowledge that v^llful false statements and the like so 
made are punishable by fine or imprisonment or both, under § 1001 of Title 18 of the 
United States Code and that such willful false statements may jeopardize the validity of 
the application and any patent issuing thereon, or any patent to which this verified 
statement is applied. 



Date of Signature 



By: 



Steven J. Martin 



David Rouille 



From: David Rouille 

Sent: Monday, November 15, 2004 10:37 AM 

To: 'sjm@cmguc.conn' 

Subject: affidavit 



Steve, 

I have received signed affidavits back from Ryan Danner and Dean Dodrill. I need yours to 
complete the filing. I need to file this by tomorrow to avoid late fees. I tried to call 
you, but your phone rings twice then disconnects (804762-5601). Please reply or call me 
to let me know if you will sign the affidavit or if you have any questions about it. 

thanks, 
Dave 

David W. Rouille 
Chapin & Huang, LLC 
Westborough Office Park 
1700 West Park Drive 
Westborough, MA 01581 
(508)366-9600 (phone) 
(508)616-9805 (fax) 

This message is intended only for the designated recipient (s ) . It may 
contain confidential or proprietary information and may be subject to the 
attorney-client privilege or other confidentiality protections. If you are 
not a -designated recipient, you may not review, copy or distribute 
this message, . If you receive this in error, please notify the sender by 
reply e-mail and delete this message. Thank you. 
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David Rouille 



From: David Rouille 

Sent: Tuesday, December 07, 2004 9:49 AM 

To: 'sjm@cmguc,com' 

Subject: . FW: affidavit regarding patent application titled "Apparatus and Methods for Converting 

Textual Information to Audio-based Output" 



Steve, 

I need to file this by December 16 to avoid another late fee. I am assuming you are off 
site or otherwise unavailable. Please confirm that you will sign the affidavit and fax it 
back to me so I can file the response. I have signed affidavits from the other inventors. 
If I don't hear from you by December 13, I will assume you refuse to sign the affidavit 
and will continue with a procedure called "non-cooperative inventor" wherein I file a 
petition stating that I sent the affidavit to you and you refused to sign, that you have a 
duty to sing as part of your prior employment agreement with Cisco and asking the PTO to 
accept the unsigned affidavit as if it were signed. They will then send you a copy of the 
petition for your records so you are aware what is going on. This procedure is a pain and 
I prefer not to go this route if I can avoid it. I have enclosed my original message with 
the affidavit attached. 



Thanks, 
Dave 



— Original Message — 



From: David Rouille . 

Sent: Thursday, November 04, 2004 2:52 PM 

To: 'sjm@cmguc.com' 

Subject: affidavit regarding patent application titled "Apparatus and Methods for Converting Textual Infomnation to Audio-based Output" 



Steven, 

I am the patent attorney prosecuting this application through the Patent Office for Cisco. 
We received a rejection, citing three patents. Instead of arguing around the patents we 
can do something called "swearing behind" these patents. In this case, the date of 
invention precedes the priority date of the three patents cited against your application. 
I have prepared an affidavit (for each inventor) which basically states that you conceived 
of this prior to the date of the other patents. I . will submit the CPOL record {with dates 
and product names redacted) as proof. Please review the attached affidavit and, if 
correct, sign and date. You can fax the signed affidavit back to me. Please feel free to 
contact me directly" if you have any questions. Once I receive signed affidavits from all 
the inventors, I will file the response. 

Regards, 
Dave 

aSOO-2413 1.131 
Affidavit ■ M... 



David W. Rouille 
Chapin & Huang, LLC 
Westborough Office Park 
1700 West Park Drive 
Westborough, MA 01581 
(508)366-9600 (phone) 
(508)616-9805 (fax) 

This message is intended only for the designated recipient (s ) . It may 
contain confidential or proprietary information and may be subject to the 
attorney-client privilege or other confidentiality protections. If you are 
not a designated recipient, you may not review, copy or distribute 

1 




this message. If you recei this in error, please notify t. sender by 
reply e-mail and delete this message. Thank you. 
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FILE COPY 



General Information 

Title: URL-Based TTS 

ID: > ■ 

Patent No.: — , — 

URL: [Application No. — ] 

Inventors: Lewis Dodrill Tddodriin. Ryan Danner rrdaimer) , and Steven Martin (s}m) 
More details on these inventors listed below . 

Date 
Entered: 

Date , ^ 
Modified: 

Date Filed: — 

Date Issued: — 

Background: There currently exist a variety of software and hardware solutions that convert text 

information into audio in the form of human speech. This "text-to-speech" conversion 
serves a variety of useful purposes such as providing textual information to the visually 
impaired or to non- visual devices such as telephones. There are, however, inherent 
shortcomings in the existing technology that can make it difficult to integrate 
into applications or exhibit undesirably low levels of performance. 



The shortcomings of existing text-to-speech implementations are consistently exposed. 
For example, the most straightforward conversion currently being implemented is to 
send a body of text to a text-to-speech converter and wait for an audio file to 
be generated. This, unfortunately, means waiting for the full conversion process 
to complete. The common solution to this problem is to wait for a certain amount of the 
conversion process to complete and then begin playing the generated audio as it's 
converted. While faster, it makes the assumption that the conversion process is fast 
enough to "keep up" with the audio being played and, furthermore, makes 
the assumption that the software component receiving the audio information has direct 
access to the audio device (pc soundcard, telephone resource, etc) to play the audio. 
The invention outlined herein provides a more elegant solution that takes advantage of 
the HTTP standard by providing URL access to a text-to-speech resource in such a way 
that both simplifies software integration and application performance. Furthermore, 
by HTTP-enabling existing TTS software, performance and ease of use is improved 
without having to re-write the complicated "engines" that convert the text and generate 
the audio. 



t of 4 



Summary: The idea of this invention is to provide a web-server-based implementation 

of text-to-speech conversion via HTTP-standard URL's. Existing "text-to-w^av" or 
"text-to-media" softv^are that exists today could be used as the basis of such a server. 
The web server must contain a CGI application or server module with the three 
following capacities: 

1 . The ability to convert a body of text received via http post to the main URL of 
the application into a series of smaller URLs each containing part of the text to be 
converted. 

2. A text-to-media capability either natively or through invocation of existing software 
residing on the web server. 

3. A mechanism to convert a URL generated by item number 1 utilizing the capability 
described by item number 2. 

In order for an application to access the server described above, it would first POST the 
text to be converted to the base URL of the server. The process would proceed 
as follows: 

The text "This is a sample body of text. It contains multiple sentences, and a variety 
of punctuation; all of these are elements of standard text that are interpreted 
by text-to-speech converters." would be sent via a FORM POST 
to http://ttsserver/main.cgi . The tts server would then return the following list or 
urls "http://ttsserver/main.cgi?This+is+a+sampleH-body+of+text%p-i-+It+contains, 
http://ttsserver/main.cgi?+multiple+sentences%c+and+a+variety+of+punctuation%c, 
http://ttsserver/main.cgi?+all+of+these+are+elementsH-of+standardH-text+t^ 
http://ttsserver/main.cgi?H-interpreted+by+text%dto%dspeech+converters.". The 
application would then use HTTP GET requests to the retumed URLs in sequence. 
The data retumed from the GET would be standard audio information such as 
WAV data. If desired, the application could GET the next URL in the sequence while 
playing the data retumed by the preceding GET. If the TTS process needs to 
be interrupted, the application may stop requesting URLs at any point in the list. 

Advantages: This invention improves many facets of text-to-speech services. By breaking up the 
text into multiple URLs from which the converted text media is retrieved, 
implementation of text-to-speech is greatly simplified. Furthermore, 
any standard audio-enabled web client can retrieve the converted audio natively. 
Another advantage is that the http standard allows for each request can be divided 
among multiple servers to enhance tts-resource availability and load balancing. 



Method of A protocol analyzer can be used to look for large URLs retuming audio data. Also, web 
Detecting servers co-resident with existing text-to-speech software could be examined to check 

Use for interaction between the web server and the TTS software. 
By Other 
Companies: 

Previous — 
Public Use: 
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